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Abstract. The fault detection process is modelled as a disturbance attenuation problem. The solution to tlus problem 
is found via differential game theory, leading to an Woo filter wliich bounds the transmission of all exogenous sign s 
sa ve the fault to be detected. For a general class of Unear systems which includes some time-varying systems, it is 
shown that this traiunission bound can be taken to zero by simultaneously bringing 

Thus, in the limit, a complete traiunission block can be adueved, making the game filter into a faultdetect.on filter. 
When we specialize this result to time-invariant systems, it is found that the detection filter attained ... *•>«£» 
identical the well known Beard- Jones Fault Detection Filter. That IS, all fault ...puts other than the one to be detected 
(the "nuisance faults") are restricted to an invariant subspace wind, is unobservable to a projection on the output. 
For time-invariant systems, it is also shown that in the Umit. the order of the state-space and the game 
reduced by factoring out the invariant subspace. The result is a lower dimensional filter wliid. »n observe only the 
faull to be detected. A reduced-order filter can also be generated for time- varying systems, though the computational 
overhead may be intensive. An example given at tl.e end of the paper demonstrates tl.e effect.vene.ss of the filter as 
& tool for fault detection and identification. 


1. Introduction 

The need for high reliability and low maintenance in complex systems such as the proposed intelligent vehicle highway 
system will require self-monitoring and fault tolerance. Schemes to carry out these tasks generally fall under the 
heading of health monitoring systems and without exception require a processor which uses sensor data to determine 
the presence and origin of failures within the system. One concept of such a processor is the fault, detection filter. 
Often called the Beard-Jones Fault Detection Filter after its originators, the fault detection filter is a specially 
designed observer wliio.1, isolates the influence of each fault, upon tl.e state trajectory, making the simultaneously 
detection and identification of failures possible. 

Since its initial formulation, tl.e fault detection filter has undergone many reinterpretations and refinements. 
White [1] derived a detection filter design algorithm based upon eigenstructiire assignment. Massoumnia (2] gave a 
geometric interpretation of the filter and also derived a reduced-order fault detector based on geometric arguments 
in (3]. Most, recently, Douglas robustified the filter and derived a new version of the filter which bounds disturbance 
transmission (4), {5], and [0]. 

J Tl,is work was sponsored by NASA-Aii.es Kesearel. Outer icralivc Agreement N... NCC 2-374, supplement 19 and Air 

Ft »rce Office of Scientific Research Grant F4l>ti20-y4-l-00S4 
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Common to all oftlie.se incarnations of the fault detection filter is an underlying structure of independent, invariant 
suhspac.es which are matched one-to-one with a particular fault and which wholly contain the state trajectory when 
the system is driven solely by that fault Design algorithms have, thus, relied heavily on spectral methods - i.e. 
specifying eigenvalues or eigenvectors. Spectral methods lead directly to the needed filter structure, but they limit 
the applicability of the fault detection filter to linear, time-invariant systems and, due to their need for an accurate 
plant model, their robustness to parameter variations can be poor [7]. 

For these reasons, we have taken a different route to fault detection filter design. We look at the fault detection 
process as a disturbance attenuation problem. The filter design, as a result, comes out of a differential game in 
which the player is a state estimate and the adversaries are all of the exogenous signals, save the fault to be detected. 
To approximate the invariant subspace structure of the fault detection filter, the game is one in which the player 
attempts to exclude the adversaries from a specified portion of the state-space, assuming all the while that the 
adversaries play their best strategy. The solution to this game results in an Hoo-type filter which bounds disturbance 
transmission. 

Since fault detection filters block transmission, it would seem reasonable to expect that in the limiting case when 
the Hoo transmission bound is brought, to zero, the game filter no longer approximates, but actually becomes a fault 
detection filter. We will prove that this is indeed the case. In fact, for linear time-invariant (LTI) systems, we will 
show that the game filter becomes a Beard-Jones Fault Detector in the sense of [4]: faults other than the one to be 
detected are restricted to a subspace which is invariant and unobservable. 

The filter that we propose here, however, is not merely an alternative algorithm for detection filter design. The 
method we develop has wider applicability than existing design techniques. Time invariance is not assumed in the 
game solution and so it can be shown that, for a class of time-varying systems, results analogous to the LTI case 
exist in the limit as disturbance bounds are taken to zero. With this method, it is also possible to deal with model 
uncertainty by treating such uncertainty as another element in the differential game [8], [9]. Finally, we will show 
that with this approach t he designer has the freedom to choose the extent to which the game filter behaves as an 
H°° filter and the extent, to which it behaves like a detection filter. This flexibility is unique to the game theoretic 
approach to fault detection filter design. 

Section 2 covers the basics of fault, detection filter theory. We define a general fault detection filter problem 
and show how the existing theory matches our definition for LTI systems. In Section 3, we pose a disturbance 
attenuation problem which models the fault detection process for a large class of systems which includes some time- 
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varying systems. The solution to this problems leads to a game theoretic filter winch bounds the transmission of all 
exogenous inputs aside from the fault, be detected. In Section 4, we analyze sufficient conditions for our game cost 
to be non-positive. This will enable us to show the existence of the filter in the limit and analyze its structure. In 
Section 5, we return to the LTI case and prove that the detect ion filter that we find in the limiting case is equivalent 
to the fault detection filter structures already existing in the literature. In Section 6, we use the limiting form of the 
game theoretic filter to derive a reduced-order estimator for fault detection. These results apply to the larger class 
of systems. Finally, in Section 7 we go through an example which shows that the filter is an effective fault detector 
for finite values of the disturbance attenuation bound and in the limit. 

2. Fault Detection Filter Theory 

In this section, we introduce and define the fault detection filter problem. The existing theory for fault detection 
filters is strongly tied to time-invariant systems and many of the key results of this theory depend on concepts which 
do not carry over into time-varying systems. Hence, we make a distinction between the existing problem and a 
definition that, we propose for the fault detection problem based upon disturbance attenuation. We will show that 
our definition matches the existing definition when applied to LTI systems. 

2.1 Time-Invariant Fault Detection Filter Theory 

Current fault detection filter theory is largely developed in [1], [2], and [4]. The geometric contol concepts upon 
which much of the theory is based are developed in [10]. 

The systems that, we consider here are linear, time-invariant, with (C, A) observable: 

t(1) = Ar(t) + Bu(t) 

,,(t) = Cr(t). 

Linear maps are denoted by mathematical italics (e g. M) and linear spaces by caligraphic text (e.g. M). Hence, 
A', is the u-dimensional state-space; >’ is the m-dimenstional output space, and U is the f.- dimensional input space. 
A X —* X, B : U -V, and C : .V — * y are matrices of appropriate dimesions and are typically called the state 

matrix, the input matrix, and the output matrix respectively. 

It. has been shown in the cited references that faults in the sensors, the actuators, and even the plant can be 
modelled as additive signals in the state equation: 

v 

r = Aj ■ + Bn + Fjl l j 0) 

; = 1 


3 



The Fj : M, — -Vs are called failure waps and are fixed, known maps which represent, the directional behavior or 
the fault.. For an actuator failure, Fj is the corresponding column of the B matrix. For sensor failures [1], Fj is 
derived from the corresponding row of the C matrix via: 

y — Cx-\r Eifti. 

Ei is an m x 1 unit vector corresponding to a failure in the ith sensor. To convert this failure into a form compatible 
with (1), a two-column failure map [1]: 

Fi = [ /, /* ] < 2) 

is used where /, is any vector such that Ei = C/. and /* = Afi - for time-invariant systems. For time-varying 
systems, /* = Afi - U . Why this is so will be explained later in this section. 

The fij’s are failure signals and represent the time history of the failure signal amplitude. In nominal, no-failure 
conditions, the ftj’s are zero. Failure maps are generally assumed to be monicso that non-zero p/s result in non-zero 
vectors, Fj/tj. In addition to (C, /^-observability, it will also be assumed that the system is output separable [1]: 

rank ( CA^‘ Vj, ..., CA**V q ] = q (3) 

where: 

Fi if i is an actuator fault, 

1 ~ 1 fi if t is a sensor fault 

Output, separability is a check that the problem is well-posed in the sense that the failures chosen in the design set 
are linearly independent. F, is the failure map for actuator faults, /* is the vector defined by Equation 2, and ft is 
the smallest integer such that CA fi ‘Vi ± 0. We make the distinction between actuator and sensor faults, because F, 
has only one column for the former and two columns for the latter. If (3) is not satisfied, then the designer needs to 
decide which failures he needs to discard from his design set. Note, that (3) is a time-invariant result. The analog 
for the time-varying case would look like a grammian matrix. 

Definition 2.1. The Fuvlt DtUetiov Filler Problem as defined in [4] is to find subspac.es W ; C T such that. 

1. Each subspace contains the image of one and only one of the failure maps (Fj := ImageFj): 

Fj C Wj * ( 4 ) 
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2. Tliesubspac.es are autpvt stptiralilc: , . 

6’VVj n2_X'W t = 0. 

3. The subspaces are (C, ^-invariant., i.e. there exists a map L : >' — * A such that. 

(A + LC)Wj C VVy ( 6 ) 

II 

Note that the output separability requirement in (5) refers to the solution of the fault detection filter problem, 
whereas the output separability specified by (3) refers to the well- posed ness of the detection filter problem itself. 

In [4] vnobscrvabilily subspaces are used as the invariant subspaces for detection filter construction. Unob- 
servability subspaces are the dual of controllablity subspaces [10] and are the unobservable subspaces, 7}, of the 
pairs (HjC,A + LC), where L is the observer gain from (6) and H, is a natural projection such that ker HjC = 
Ti + kerC (kerC refers to the Kernal or Null Space of C). Hj can be found via: 

H^l- {CA e > Fj )[(CA P ’ Fi ) T {CA»’ )j“ 1 (CA* Fjf. (') 

Again, Pj is the smallest integer such that CA^>Fj ^ 0 and 

Fj = [ Fi ... Fy_i Fj+i ... F,] ( g ) 

Roughly speaking, Hj blocks out the portion of the state-trajectory which lies in the other invariant subspaces. 

Unobservability subspaces are crucial for spectral design methods because for any such subspace, %, botli the 
spectrum of (A + LC\Ti) - t he restriction of (.4 + LC) to 7i - and the spectrum of (.4 + LC\X /T.) - the restriction to 
the factor space - can be completely specified by I 1 . If an invariant subspace other than an unobservability subspace 
is used in a detection filter design, it is possible that some of the eigenvalues of ( A + LC) will be fixed by the invariant 
zeros of (C.A.Fi)- This could be problematic if these zeros are in undesirable locations. We will briefly discuss 
invariant zeros and where they appear in the game filter in Section a so that our results can be directly compared to 
existing detection filter design methods. 

When the three given conditions art* realized, the result is a Luenherger Observer. 


x = Ax + Bu + L{y - Cx). 

l When there is only one „„..l, servility sul.space l.. consider, this means that the entire spectrum of cWI-lnopMalc matrix ( A + LC) 
can he specified. When more than one nm.hsei val.il ily involved, an extra condition called mutual ieUetab.lity [l] is needed to speed) 

o((A + LC) 
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with error dynamics governed by (r. := r - r): 


i = (A+ LC)c + 53 Fan ( <J ) 

j = i 

Equation 5 implies tliat /tj is restricted to an invariant subspace VV, whose image under C is disjoint from all 
other such subspaces. Hence, by the definition of Hj and equations (4) - (9), the signal. 


Zj = Hj(y-Cx) = HjCe. ( 10 ) 

will be driven solely by the fault / tj . A non-zero value of zj should simultaneuosly detect and identify the fault /ij 
Given (10, we can derive the sensor failure map for the time-varying case. A sensor fault leads to:= H\Ct where 
e = e + /,/i,. Differentiating e, gives us an equation in the form of (9), leading to the failure map: 

Z = (A + LC)Z - Afi/ii + fim + fn'ti = (A + LC)e + [ /, /,* ] | ^ j 

2.2 A Definitiou of the Fault Detection Filter Problem based upon Disturbance Attenuation 


Let us now consider an alternative and more encompassing definition of the fault detection filter problem. Consider 
a linear system in which q possible faults have been modelled: 


m 

m 


i 

A(t)x(t) + B(t)u(<) + FxWfHit) + 53 Bi(f)/x.(<) 

i = 2 


C(t)x(t) + u(t). 


It is desired to detect the appearance of /<] (the “target fault”) in the presence of sensor noise, u, and the possible 
presence of other faults //;,»' ^ 1 (the “nuisance faults”). Following the standard assumptions of section *2.1, we will 
assume that each of the F.’s are moiiic. and that ( C,A ) is an observable pair. Also, since u is a known function 
of t € [to.ti], we will drop the Bu term for convenience. We will also neglect to explicitly show the possible time 
dependence of the system matrices, though the reader should keep this possibility in mind. For convenience, we 
define: 


/* 2 


= 


< 


/ 4 f 




and use the definition of F { (8) so that the state equation becomes: 


j = At + Fi/ii + Fii'ij 


(i 



The definition that, we propose is based upon disturbance attenuation. We use (10) and define the corresponding 
residual signal r, associated with /i, as the output signal A disturbance attenuation problem would be to limit the 
transmission of the nuisance faults and the sensor noise to this output. For a fault detection filter problem we want 
to block this transmission entirely. 


Definition 2.2. The Fault Detection Filter Problem is to find an estimator such that: 



and: 


]N!l 

IM 2 


^ fl- 


it 


Clearly, in the time-invariant, case, the solution to the fault detection filter problem as defined by Definition 
2.1 solves the general fault detection filter problem that we have defined above. Later on, we will show that these 
definitions are equivalent in the time-invariant case by showing that the solution to Definition 2.2 solves the problem 
defined by Definition 2.1. 

The definition that we propose is needed when we consider time-varying systems. In such cases, we cannot talk 
about invariant subspaces and also observability becomes a trickier concept. Thus instead of defining the structure 
of the final filter, we must content ourselves with merely describing its action. 

Now, because we are dealing with time-varying systems, we must define our projector H i appropriately: 


Hi = I -CB i [(CB,) T {CB i )]- 1 (CB i ) T 


(11) 


where: 

Bi = F i (12) 

Bj = ABj-i + Bj-i (13) 

and i € Z+ is the smallest, integer such that: 

C’Bi? 0 ( 14 ) 

For time-invariant systems, (11) reduces to (7). Equations (12) to (14) come from the Gob Transformation [11] We 
will use the Gob Transformation again in later sections. It will be assumed that the system matrices A(t),C(i), F t (<) 



the number of iterations of (1.1) needed so that (14) is satisfied is constant over the entire interval, [<».< i]- That 
is, the time-variations of t he system <lo not change the dimensionality of the detection problem. This restricts the 
applicability of this analysis to a subclass of time-varying systems, but it allows us to avoid expending the effort 
which would be needed to deal with exceptional cases. Calling ( 11 ) a projector is a slight misnomer since it will be 
a time-varying matrix, but by it’s construction it will be such that Ker H(t ) i = Her C(<) + Im flj Vt € (<o, h) which 
is our main concern. 

3. A Game Theoretic Filter for Fault Detection in a General Class of Systems 

3.1 The Disturbance Attenuation Problem 

We arrive at a solution to the fault detection filter problem as defined by Definition 2.2 by first solving the disturbance 
attenuation problem. The solution to the fault detection filter problem then comes when we take the limit of the 
disturbance attenuation solution. The results that we find here, however, are valuable in their own right. As we will 
see, the game filter that we get from the disturbance attenuation problem is itself a useful filter for fault detection. 

We begin by quantifying the problem objective with a disturbance attenuation function, the ratio of the norm of 
the output to the norms of the inputs. For this problem, the function is: 

j£» ",c<— ( i5) 

+ Hb + PW* - i)ia,m + IWM - iollj.-. 

where Ni := I - Hi and M-j, V, R lt Pu are weighting matrices. The disturbance attenuation problem is to find an 
estimator so that for all adversaries v G ^".([ti , /*]> ^(O) £ ® ■ 

Daj < 7- ( 16) 

We will refer to 7 as the disturbance attenuation bound. Once again, the assumptions that we will make are: 1 ) 
(C, A) is a an observable pair 2) F,, * = 1 - - q is monk 3) i, the number of iterations of (13) needed so that (14) is 
satisfied, is a constant. 

To solve (16) we convert, it into a differential game with cost function: 

J = f'[\\HiC(r - i)||* , - 7(11/1*11;,-, + + ||A'iC(x - *)!&.)]'" - IWM - iolln.- ( 17 > 

J to 

Note that n 0 := 7 P { ~ x . We want to find: 

min max max max J <0 (18) 

r *> r(C„) 


subject, to: 
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r = At + Fuh 


(19) 


Ait element that, is missing in our problem statement (17), (18), (19) is the target fault, /ij. This is not an 
oversight. It would seem logical to include enhancing the transmission of /t\ as part, of the game, but there is no 
obvious way to include such an objective in the game cost. Moreover, extremizing the cost with respect to fi\ leads 
to assumptions upon the temporal behavior of the target fault. This can be quite detrimental to filter performance if 
these assumptions are wrong (which is why fault detection filters are designed without any such assumptions). Thus, 
since //j is not part of the differential game, we set it to zero for convenience when we work through the solution. 
This places the burden on the designer to make sure the set of faults that he chooses for the filter design leads to a 
well-posed problem. Well-posedness is discussed in Section 2 and for LTI systems is easily checked by Equation 3. 

3.2 Maximization with Respect to *(<o) and ft 2 

We will solve our problem in two steps beginning with the subproblem: 

max max J < 0. 

P2 r((«) 

The reasoning for this particular order of the extremizations is given in [12]. 

We begin by converting the sensor noise term to the equivalent ||y — Cx ||^_i and by appending the 

dynamics of the system to the cost with a Lagrange multiplier, A T : 


=/" 


[||// 1 C(x-i-)|£ l — )i 


I +11.7-0 


!!»• 


+||A^iC'(r-E)||^ | )+A T (Ai:+Fi/'2-r)]df-|k(iu)-io||n ( ,' ( 20 ) 


Integrate \x by parts: 


J = f 1 [||// 1 C (*- e )||£ 1 - 7(il/<2||^-« + ll»/ -OH?,-, +IWO*-i)lffl 1 ) 

J t o 

+A t (At + Fuh) + A T a-]r// - ||x(<„) - i|,||n (l + A(<„) T x(t„) - A(t,) T x(t,) 


and then take the variation of (21) with respect to ftj ami x(<n): 


( 21 ) 


6J = 



T) T C T HlQx H\C + 7(7 - Cx) T V~'C - y(T. - i) T C T Nl /7,A/,C + A t + A T A]kx 
7 jtF, M ~ 1 + A t F\ ]fyi •.*}</( — [(*(«„) — E.,) T no + A(<ii) T ]^x( 1()) — A(t i ) 6x(ti). 


( 22 ) 


<) 



The above implies that first-order necessary conditions for J to be maximized are: 

ft-, = ( 23 ) 

-A = A t \ + C t (H'[QiH'[ - 7N‘fRiN l )C(x-T) + -yC T V-'(ij-Cx) (24) 

A(^) = 0 ( 25 ) 

A(i 0 ) = n n [r(<o)-io] < 26) 


Substituting (23) into our dynamics (19) and using (24), we obtain a two point boundary value problem: 

f * 1 _ [ A i/'iM 2 F 1 T 1 f * 1 + 

\ A / - [ -C t (HTQiHT -yN?R l N 1 -- t V- 1 )C -A T JIM 

{ C T (HTQiHT -yNTR l N 1 )Cx-- r C7V- 1 y } (2 ° 

If we assume solutions i* and A* to (27) and a quadratic form of the optima) return function, then. 

A* = II(x* - x p ) (28) 

where x p is a measurement, dependent variable which will be shown to reduce to the estimate of the optimal stale. 
Using (28) and the first, equation of (27), the second equation of (27) becomes: 

0 = (n + A t U + n,4 + -nF,A/-*Fi r n + C T (HjQxHT - yNj RxNx - yV-'Wx' 

7 

-llxp - nxp - A T nx,, - C T (H?QxHl - yN? RxNx)Ci + y C T V~ l y. (29) 

Now, add and subtract 7 C T V~ l Cx and [II A + C T (Hf Q\Hf — jNf R\Ni — 7 V l )C]r. p to (29): 

0 = [il + A T n + UA + -nFxMjFfn + C T {HfQxHl - yN J F,A'i - yV~ x )C](x’ - x p ) 

7 

-ni-p - nAxp - [c t (hIQxhJ - taT Ri^i - y c T v~ l )c}(i - x p ) + yC T v~\ y - a). (30) 

Thus, if we set: 

-ri = A T n + [\A+ -nFxM?F?U + C T (HlQiH‘[ -yN? RxNx -yV~ l )C (31) 

7 

n^, = X\Ax v -C T {HjQxHx -lNTRxNx-yV-')C{x-x p ) + yC T V-\y-Cx). (32) 

(30) is satisfied identically. (31) is an estimator Riccat.i Equation. If we set: 
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n = yP~\ 


(33) 


we can convert (31) into: 

p = PA t + PA - PC T {V~ l + NfRxNi - ^HjQiHjyCP + FiMiF? (34) 

which is a Riccati Equation of the sort seen in (12], [13], and [14]. (32) looks like an estimator, but its final form will 
not become apparent until we solve the second hair of the game problem. 

3.3 Minimization with Respect to x and Maximization with Respect to v 

The first part of our game solution led to optimal values for fi and *(to) : 


* 


*(*<>)" 


-FiM 2 F?\ 

7 

n^A(to) + *o 


(35) 

(36) 


If we substitute these optimal values into the cost function (17) we obtain a new cost, J, which is written as. 

J= A||( * - i)ll^r <JlA| . 7Ar r RlAfl)c - ^ ~ Cr Wv^ dt ~ (37) 

Jto 


Maximization of the cost with respect to v is unnecessary at this point. Since v = y-Cx and y is a given measurement 
vector, v- is determined once x* has been. Hence, the second part of the solution reduces to a single minimization: 


min J < 0 


To begin, we add the identically zero term: 

- Il'MMIIrio,)-* + / = 0 

J ti\ 

to (37). After applying the boundary condition for A at /-i (25) and carrying out the differentiation of the ||^Hn-» 
term, we get: 


J = 



^c T (ii‘[Qiii,-yNfR,Ni)C Cx Hv'-> 


+A T n-'A T + A T n-‘A + A T n-'A]d< + ||A(t«)lln-. (l|l) _n, 


(38) 


Note that (38) gives us a boundary condition for (31): 
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n(M = n 0 - 


(39) 


Applying this boundary condition and substituting the differential equation for A, (24), into (38) leads to: 

/= f '[X r (-An- 1 - n _, A T - FiM 2 F? + ri _1 )A + (z - x) t C t (HJQ\H\ - yN J R x Ni)C(x- x) 

Jt o 

-(i - x) T C T (HjQiHi - yN? R l N i )CTl~ 1 X - X T n- 1 C T (H?QiHi - yN? R iNi)C{x -£)- 

Y[(y — Cz) 7 'V ,-1 (y — Cx) + (y — Cx) T V~ l CU 1 A + A I 'll l C T V *(y — Cx)]dt. (40) 

From (31) the differential equation for II _: is: 

ri-» = _n- 1 nn - 1 = ir l A T + AII - 1 + ^FiM 3 F? + n~ 1 C T (.H?QiHi -yN^R^ -yV~ l )CU- 1 . (41) 

After we insert (41) into (40) and cancel terms, we are left with what turns out to be a pair of quadratic terms: 

J = j" {(n^A - (r - x)) T C T (H?Q x H 1 - yN? R l N l )C[U~ l X - (x - £)] - 
Jtv 

7 {Cir *A + (y - Cx)] r l/- 1 [Cn~ 1 A + (y- Cx)))dt (42) 

Now, use the solution for the optimal value of A (28) and substitute into (42) to get: 

J = f\(£ - x P ) T C T (H?Qiff l - yN ? R x N x )C{i - x P ) - y{y - Cx p ) T V~ l (y - Cx P )]dt. (43) 

Jto 

Because of the projectors H i and N x , the minimizing value of £ is: 

£* = x p mod ker//iC (44) 

Using (44) as a guide, we rewrite (32) as: 

n t = n A£ m +yC T V- l (y-Cz m ) (45) 

In (45) we have used x m - x ft instead of (44). However, this choice is justified in that an adjustment of (32) in the 
manner suggested hy ( 44 ) would huild in a bias to our estimate which would be better in the sense of the game but 
not. in our ultimate objective which is to design a fault detection filter. Since n is positive-definite for 7 > 0, we can 
rewrite (45) as: 

r = Ax' +jn- 1 C T V’ l (y-Ci m ) (46) 
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Alternatively, the analyst could use (.14) and: 


i = At + PC T V~ l ( y - C£ m ). ( 47 ) 

This form of t.he filter is equivalent to (4G), however; experience has shown that numerical problems are more likely to 
be seen when trying to find a solution to (34) than (31) when 7 is brought to extremely small values. For convenience, 
we will use x instead of r* when referring to the optimal state estimate with the understanding that it is the estimate 
that comes from the game solution which is being used. 

From (44) we can see how this game filter mimics a fault detection filter, x does better by inducing estimation 
errors in the space defined by the projector H x than by trying to estimate the state exactly. This implies that 
knowledge of the time history of fi 2 , either by measurement or estimation, is not needed. 

The solution of the fault, detection filter problem exists at the limit of the game solution when 7 is taken to zero. 
Finding the solution or even showing that it exists is not a straightforward matter. In both versions of the game 
Riccati Equation (31) and (34), there are terms which go to infinity as 7 goes to zero. Kwakernaak and Sivan (15], 
studied a similar situation for the linear quadratic regulator. The linear-quadratic cost function in their problem, 
however, is always non-negative while our game cost can be both positive and negative. Hence, their results are not 
directly applicable here. Also, it is well known (14] that for game Riccati Equations, there is a minimum value of 7 
for which the equation will yield a positive-definite solution. Below this critical value of 7 any number of different 
phenomena could occur (e.g. eigenvalues on the imaginary axis) which make positive-definite solutions impossible. 

It turns out that we can resolve the second difficulty fairly quickly. By decreasing the noise weighting V to zero 
along with 7 - i.e. V — 0 as 7 — • 0 - we can find solutions to (31) and (34) for smaller and smaller 7. What we get in 
the limit turns out to be a singular filtering problem. This insight, in fact, is the key to resolving the first difficulty. 
By using a pair of techniques from singular optimal control theory in the next section, we will be able to show the 
conditions for the existence of the limiting solution and the nature of this solution when it exists. 

The Limiting Case Solution via Singular Optimal Control Technic[ues 

4.1 Conditions for the Non-Positivity of the Game Cost: A 11 LMI for the Game 

In this section, we will find sufficient conditions for the non-positivity of the game cost. These conditions fall out 
when we manipulate the cost slightly and then set x to its optimal strategy found in Section 2. The game cost then 


becomes a single quadratic form: 



(48) 


J{*, x(t<i), lh,v) = [ £ t W£<U 


where £ is some vector consisting of linear combinations of the game players. The non-negativity of the cost then 
hinges on the sign definiteness of W, giving rise to a linear matrix inequality. Historically, this technique was first 
seen in the singular optimal control theory [16] and [17] and the derivation seen here follows in that vein. 

We begin with the cost function as given by (20). Note that the (x - x) terms have been combined: 

J= /“(IK* - - ^llv - C’-llt-J'" - ll*<«") - <«) 

J In 

We now append the dynamics of the system to (49) through the Lagrange Multiplier (x - x) r II: 

J = [ [ll( x - x )Hc r («T'Q,«i-7Ar x fliAr,)c — f~ l ~ "*11® — Cx Wv-' + 

(x - x) T n (Ax + Fifa — x)]dt — ||x(t 0 ) — *o|ln 0 - 

Add and subtract to (21) the terms (x - x) r n Ax and (x — x) T IIx. Collect terms to get: 

J — f ilK* — r ^ln/t+c r (« 7 ' — 7 r llf i 2ll.w- 1 — flly ~ C* Hv-» 

J to 

+(x - x) T nFi/i 2 - (x - x) T n(x - x) + (x - x) T [nAx - IIx]}<ft - ||x(t 0 ) — x o|ln 0 ( 51 ) 

Note, we have moved nA into the weighting ||(x — x)|| 2 . As we continue along, new terms will be appear in the 
weighting of ||(x — x)|| 2 as we manipulate the cost function. Integrate (x - x) T n(x — x) by parts: 

J ~ f {ll( x - ;r )llh+n4+C r (A7'Q,Hi— rATfrttAr.K? “ * - Till/ ~ Cr \\\,. , -(- (x - x) \[F\H 2 

J tty 

+(x - i:) T [n.4i- - Ux] -f (x - x) T n(x - x)}dt - ||x(<o) — *n|ln„-n(«„) “ H x (*l ) “ *(* l)lln(f t ) (^) 

Substitute the state equation for x (19) and add and subtract x T i4 T II(x - x): 

^ = f {IK 1 * ” x ^llii+nx4*>t T n+c T (//j'gi//,-TA T r ft i^ r i) c ” “ x ) l 1 '* 

j t u 

+it fJ n(x - x) T - 7 ||t/ - Cx||J._, + (x - i-) r [-ni + nAi] + [-ni 

+nAx] r (x - x)}dl - ||x(t„) - *ui||n„-n(i„) _ ll x (M ~ x (*i)lln(i,)- ( 53 ) 

We are now going to manipulate the j|j/ — Cx||(,_, term by adding and subtracting Cx inside of the term so that 
it reacts ||(y - C'x) - C(x - x)||j,_, . Expand this quadratic term out and collect terms so that we end up with: 
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J= f X (IK* - i )llrt + n>, + ^n + cT(«rQ.«.-^r«.A'.-^-')c ~ + (x " 

*^t 0 

+tfFl n(x - r) T - Tll-V - Ci\\l + (x - i) T [-ni + n Ax + yC T V~ l {y - Ci)\ 
-[ni- + UAx + y C T V~\y - Ci)] T (x - - ||*(to) - *o|ln 0 _n(«„) ~ INM “ ^(‘Ollnc^) 

Using (45) we can eliminate a pair of terms in (54). We are then left with a quadratic in the form: 

J-f t T Wtdt - ||*(M - *o||n 0 -n(«„) ~ ~ 

Jtu 


where: 


f (* - *) 

( = { h 

{ (y-d) 


} 


and: 


W := 

Define the upper 2x2 block of W as: 


C T {HjQ,H, -yV~' -yNfRiN^C + A^ + UA + tl n F, 0 ] 

ft n -7 Mf 1 o 

o U -yV~ l 


f C T (HTQ l Hi-yV- 1 -yNTRiN l )C + A T U + UA + U TIF, ] 

lV(n) := [ FT n -yMj 1 \ * 


For matrices II > 0 such that: 


( 54 ) 


(55) 


(56) 


w(n) < o < 57 ' 

n„-n((„) >o (K> 

n(t,)>o 

W is clearly negative semi-definite. Hence, we need only pay attention to the smaller LMI, W(II). 

For 7 > 0 , it is easy to see that, the R.ic.cat.i Equation (31) of the previous section is embedded in (56). In fact the 

solution of (31) is the solution of W'(II) which minimizes its rank [18). Thus with (56) and (45), we retain the results 

of the previous section, hut. in a form which can he easily analyzed in the limit 7 — • 0 . If we define V = linv_ > 7 1 
sufficient, conditions for J < 0 in the limit as 7 — 0 are: 

IIF, = 0 (60. 

ii + A T n + nA + c T (HT(hHi-v~')C < o. (ci • 
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along with the boundary conditions (58) and (59). 

(60) clearly shows that in the limit, the Riccati Matrix, 11, obtains a non-trivial null space which contains the 
image of the nuisance failure map, F\ . Moreover, those familiar with singular optimal control theory will recognize 
(60) and (61) as conditions seen previously for the singular LQ regulator (see e.g. [16]). This tells us, first of all, 
that the limiting form of this game filter is a singular filter. It is likely that similar results hold for game theoretic 
(tfoo) filters and controllers in general. Secondly, singular optimal control provides a wealth of results and insights 
which we can apply to the analysis of this filter. This is, in fact, what we will do next. 

4.2 A Riccati Equation for the Limiting Form of the Game Theoretic Filter 

Goh (see [11]) used a transformation on the control input space to derive a full-order Riccati Equation for the totally 
singular linear quadratic regulator problem. By applying the same type of transformation on the nuisance fault input 
space, we can obtain a similar equation for the limiting game filter. The existence of the solution to this equation 
gives the condition for the existence of the game solution in the limit. We have already seen this transformation 
applied to the construction of the time- varying projector, Hi, (11). Because this Riccati Matrix must also have a 
non-trivial null space, we will not he able to use the solution to this Riccati Equation directly in a game filter, but 
this matrix will also prove to be useful when we look at reduced-order filters. 

We start with the game cost for the limiting case: 

J = ^ ~ j ll r — ^C T HjQiHiC ~ _ 

** *'*<1 

where V~ l := lirn 7 -.o('yV r )~ l - Now, define a new nuisance fault vector, f>\ and a new state vector, ix\: 

pi := f fin dt (62) 

Jt u 

a\ := X - FiPi = X - BiPx (G3) 

Note that we have defined a matrix B x := F\. The reason for the numbered subscripts will become apparent later. 
Differentiating ((>3), we get: 

dj = A<\ \ 4- (AB\ — B\ )pi . (64) 

as a new state equation and: 


1(5 



( 65 ) 


J’ - f [| |r r i - i ‘llcT//TQ 1 //,r + ( rtl - i) T C T iijQiH\CBipi + pf BjC T HjQ\H\CB x pi 

Jt„ 1 

\\y-Co'i\%- i -{y-Cai) T V- l CB x px-r'[BTC T V-\y-C<, x )-\\in\\ i B T C Tv-'cB) dt 

as the new game cost.. Because Hi is a projector constructed so that HiCFi = 0, we can simplify (65) to: 


J'= [ [||«i-i|lcTAT < , lA , c -||y-^«'illp-> -(y-C<*i) T V 1 CBipx 
J t\\ 

-pJbJC t V \rj-Co l )-\\pi\\ 2 B T. cTV -i CB ] dt. ( 66 ) 

Now, if B"[C t V~ 1 CB 1 > 0, we can solve the following differential game: 

min max J* < 0 

i Pi 

subject to (64). Because of its similarity to the derivation given in section 3, we do not provide the solution here. 
But if the interested reader follows the steps in section 3 J , he will find that the solution leads to a Riccati equation. 


-S = SA + A T S + C T (HlQ l Hi-V ')C + {S{AB X - B x ) - C T V 1 CB 1 ] 

x(BlC T V~' l CB l )- 1 [(AB l - B x fS - BjC T \r l C} (67) 


with the boundary condition: 


5(<«) = 0. 

(68) 

It may happen, however, that CB X = 0, which would make BjC T V 

1 CB\ = 0 and which would invalidate our 

Riccati Equation (67). The remedy to this situation is to perform the same transformation as before but on the pi 

input space via the recursion equations: 


Pi = / Pi-\<tt 

(69) 

5, — ABi-i — 5i-i 

(70) 

(i, = x — Bif» t 

(71) 


The process stops once a 5j is found such that (75, ^ 0. The game is then. 

^ Hint : tin* first step involves converting y — Co into (y — Cx) + C(a — t) 
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mill max J* = f [||«r* — ^ct^tq n c - llv ” C a *llp-» ” (.V ” Coi) T V CBiPi 
* *• Jtv 1 

—pj bJ c T v~ x {y - Cat) - \\*\\l TC Tir' C B.] di (72) 

subject to: 

dr* = >lor,* + (ABi — Bi)pi- (^) 

The general form of the Goh Riccati Equation is then: 

-S = SA + A t S + C T (l/f Qii/j - F -1 )C + [S{ABi - Bi) - C T V~ l CBi] 

x(BjC T V~ l CBi)- l [{ABi ~ B,) T S- BTC T V~ l C] (74) 

The following theorem shows that (74) is a Riccati Equation for the limiting form of the game theoretic filter. 

Theorem 4.1. The solution 5 to (74) satisfies the sufficient conditions for the non-positivity of the game cost: 
Equations 60 and 61. 

Proof. (The proof given here follows Bell and Jacobson [16] (pg. 121). Due to its importance, we list it here.) 
Clearly, (74) implies that: 

S + SA + A T S + C T (Hj'Q i H l -V~ l )C< 0, Vte[t,„t,]. (75) 

which is (60). Now, pre-mult.iply (74) hv B, and add -Bj S to both sides of the resulting equation to get: 

-BjS - BjS = BjSA- BiS + Bj A T S - Bj C T V~ l C + [Bj S(ABi - Bi) - Bj C t V~ 1 CB,} 

x(Bf C T V~ 1 CBi)~ 1 [(ABi - BifS - C T V~'CBi ] (76) 

Rearranging terms leads to a differential equation in B f S with (68) as the boundary condition. 

-j t [BjS) = BjS[A + Bj S{ ABi ~ B,){BTC T V-'CB,)-'[{AB, - B,) T S - CW'CBi}. ( 77 ) 

The solution to (77) given (68) is: 

BT(t)S(t) =0 , Vf € [lii.<i] 


The necessary condition (60) actually requires that Ff S{t) = 0. However, since B\ = F\ and with the following 
proposition, (60) is satisfied. ® 



Proposition 4.2. Let i G N lie the smallest, miinher such that. C B, ^ 0. Then, the solution, S, to (110) is such 
that 


SBj = 0, Vj < t. Vt G [In. ti] 


(78) 


Proof. That. SB, = 0 is a result, of the solution to the game and is analogous to the 5F ( - 0 condition found in 
the solution to the original game. The proof that SBj = 0 for all j < i can be found in [19]. The proof used there 
is an inductive argument which applies the same steps used above in Theorem 6.1 to prove SB, = OVf G [<o.<i] to 
show that the same holds for all j < t. 

5. The Equivalence of the Game Theoretic Filter to the Beard-Jonfcs Filter in the 
Limit 

In this section, we return to time-invariant case and show that for these systems the solution to the fault detection 
filter problem as stated in Definition 2.2 also solves the problem as stated by Definition 2.1 - i.c. limiting form of 
the game theoretic filter is a Beard-Jones Fault Detection Filter. The required invariant subspace is the kernal of II. 
To prove to this assertion, we first need a minor lemma: 

Lemma 5.1. (kerll O kerC) C kerll 

Proof. Let x G kerll fi kerC. Pre-mult.iply (61) by x T and post-multiply by x. This leaves: 

j- t IIt < 0. 

Since II can be negative or positive-definite, this can be true in general if and only if: 

r T ilx = 0, 

which implies our proposition. ® 

Theorem 5.2. kerll is a subspace which solves the fault detection filter problem 

Proof. The three conditions listed by Definition 2.1 are subspace inclusion (Equation 4), output, separability 
(Equation 5), and (C, ,4)-iiivariaiice (Equation 6). (60) clearly implies subspace inclusion Since we are trying to 
detect, only one fault., output separability is satisfied trivially. Thus, all that remains is to show (C. .4)-iuvariance. 
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From Wonham [10], a necessary and sufficient condition for kerll to be (C, j4)-invariant is that: 

j4(kerll n kerC) C kern 

Therefore, let x € .4 (kern n kerC). Tliat is, there exists a vector c such that: 

x = A< and ric = C< = 0. 

Now consider (61). If we post-mnltiply (61) by c and use our lemma, we get: 

IL/U<C => c r i4 T n^c<0. 

Since n > 0, this means that: 

<; t A t UA<; = 0. 


which implies that: 


nyk = ni = o => r€kern 

From this we conclude that /l (kern n kerC) C kerH and so kerfl is (C, .^-invariant. U 

Remark 1. In actual practice, it is not necessary to use the limiting form of the filter. In many ff<» designs, 7 
is not taken to its smallest possible value, but left at one which results in an acceptable compromise between all of 
the (usually competing) design objectives. The virtue of a game theoretic approach to fault detection filter design 
is that it gives the designer a “knob” with which he can make the filter more like a Beard-Jones filter (small 7 and 
small V) or more like an filter with more emphasis on sensor noise attenuation (larger 7 and V). U 

Remark 2. It. should be noted that a Beard-Jones fault detection filter can detect all of t.he // ; s. The filter that 
we propose here can detect only one fault at a time. ® 

Remark 3. Lee and Gibson derive a filter for fault detection via linear quadratic methods in [7]. They do not 
discuss their work in relation to fault <let.ect.ion filters, but in many respects their final result is similar to the game 
theoretic filter described here. Moreover, they also apply their work to the same example that we examine in the 
next, section with similar results. ^ 


20 



Iu Section 2 we noted that niiohservability suits paces are used in current, fault detection filter design methods 
because they allow the designer to specify (within complex conjugate symmetry) all of the eigenvalues of the filter. 
Such design freedom exists with these subspaces because they include any invariant zero directions which arise out 
of the triple (C, A, Fj). 

Invariant zeros [20] are those complex numbers A such that the system matrix. 


P(X) = 


A -XI Fj 1 

C 0 J 


loses rank. Invariant zero directions x are those complex vectors such that: 


f a -** AH * l = o 

C 0 J \ w / 

Invariant zeros are a concern in fault detection filter design because they cannot, be eliminated by output injection 
feedback, i.e. an estimator. Moreover, Douglas (Proposition 2.9 [4]) has shown that if we do not include invariant 
zero directions in a (C, y4)-invariant subspace, the corresponding invariant zero will show up as an eigenvalue in the 
factor space when we try to design an estimator for the system. 

In the next theorem, we will show that, the game theoretic filter places invariant zeros in the kernal of II. Since we 
have already shown that kerll is a ( C , j4)-invariant subspace, this theorem then implies that kerll is an unobservability 
subspace. For our purposes, this result is not. as important as it is for spectral design methods since pole locations 
fall out from the game solution. It does, however, connect this filter to existing detection filters by showing that 
the invariant subspace formed by the game theoretic approach is the same kind chosen in standard detection filter 


design algorithms. 

The proof to the upcoming theorem is based on the fact that positive semi-definite, symmetric matrices such as 
II always have non-singular, transformations - say T - that are orthonormal (r r r = 7) and that convert the matrix 
into the form: 


rnr T = 


n o 1 

o o J 


(79) 


where FI is positive definite. Define: 


c r T = ( c i c, } 


iMr r = 


f An 
[ An 


A 1 2 
A -j 



Because UF X = 0 implies TUFi = 0, we can immediately conclude that: 
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rnr T rFi = 

Which, since fl is positive-definite, implies. 



' n o' 

' Fn ‘ 


0 0 

F 22 


= RFu = 0 . 


Fn = 0. 

Theorem 5.3. The invariant zeros of (C, A, Fi) lie in kerfl 


Proof. 


TVansform the system matrix P( A) using the transformation matrix, T described by (79): 





An — 

A \2 

0 

' r o' 

' A- XI Fi 

r T 0 1 

An\ 

A 22 — A/ 

Fn 

0 / 

c 0 

. 0 1 J ” 

_ Ci 

c 2 

0 


(80) 

(80) clearly shows that if invariant zeros exist they can only arise from the triple (C 2 , A 22 , F 12 ) which corresponds 

to the subspace determined by kern. In fact, (80) shows that the only kind of zeros which could occur in the range 

of II are output decoupling zeros [20] arising from values of A which make: 

An ~ M 
Ai 1 

Ct 

lose rank. However, since we have assumed that (C, A) is observable, these zeros cannot occur. 


II 


6. Fault Detection with the Limiting Form of the Game Theoretic Filter 


In this section, we will show that a reduced-order fault detector can be derived from the limiting form of the game 
theoretic filter. The results from this section are more easily applied to time-invariant systems, but we will give an 
overview of how to apply these results to time-varying systems. For the moment, let us restrict ourselves the LTI 
systems. Using the transformation, f, defined by (79), set: 



Pre-multiply (45) by f and make use of the identity r T T = / to get: 


(rnr T )»y = (rnr r )(r, 4 r 7 V/ + rc 7 V \ v -cr T i,)) 


(81) 
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The transformed filter equation (81) is seen to he: 


) (82) 


(83) 


(84) 


[7 $]{ !:}=[? :][£ 1 { £ 1 

From (82) we get a dynamic equation for i )\ : 

Tliy i = nXni /1 + UAnin +CjV \y - C\i}\ — C? 172 ) 

and a static equation for i] 2 : 

n = (cZv~ l c,)- i cZV~\x J - Cim). 

Define 

A' := (CTF-'c^-'CrT -1 
so that the substitution of (85) and (84) into (83) gives us an estimator for t) X : 

= A„») 1 + fir 1 CrF _1 (/-C ; A') + ^i 2 /i'](y-Ciqi). (86) 

To see that the reduced-order estimator (86) is unaffected by the nuisance fault £ 2 . we will derive the error 
equation for the reduced-order filter. Define: 

f/ = ^ ^ | := Tx €\ := 171 - qi e2 := 172 “ *72 

We begin by premultiplying the dynamical equation (19) by the Riccati Matrix, II. Since IIFi = 0, we get: 


(85) 


ni = n Ax . 


' n 

0 ‘ 

r »?i 

1 [ n 

0 ' 


Ai 1 

A 12 

J »h 1 

0 

0 

1 »/-* . 

1 l 0 

0 


A-n 

A 22 

1 »fc / 


This can be pre-multiplied by T and manipulated into: 

.. t r . , t f \ 

(87) 

As with the estimator equation, (87) shows that only a portion of the state-space possesses dynamics: 

T1 7/! = TL4ii7/i + II A 1 2 1)'* (88) 

Using (88) to get an error ecpiatiou would leave terms in 1/2 or tv. In anticipation of this, we transform the measure- 
ment equation: 


1/ = Cx + r = CT r rx + 1; = Ci 7/1 -4- 7/2 + v 


(89) 
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(90) 


ami use (89) and (84) to solve for <•>'■ 

C-, = (Cjv~'c-,r l {CTV~ 1 C\c l +cjv~'v) = A'(C’iti - t>) 

Subtract (88) from (83) and substitute (89) for y: 

TTei = TT/lnCi + TI-A^e? + Cj V l Ci€i+CfV C 2 e 2 + C T V v 
Using (90) and collecting terms, we can turn the previous equation into: 

cj = [An - 1 r l Cj\T\l - C 2 I<)Cx - A l2 KC x )ex + [I T l CfV~\l - C 7 I<) + A l7 I<] v. (91) 

Note that nuisance fault, /i 2 , appears nowhere in the estimator (86) nor in the error equation (91). Thus, in the 
limit, we get a reduced-order estimator completely uninfluenced by the nuisance faults. The term ( CjV C 2 ) 
appears in various places in the reduced-order estimator. This inverse will always exist since V is positive definite 
and since the assumption of (C, A) observability guarantees that C 2 will have full column rank. 

Remark 4. The reduced-order filter derived here is similar to the residual generator derived by Massoumma, et al. 
in [3]. An important difference, however, is that Massoumnia begins his design process by factoring out the reachable 
space of the nuisance faults. As a result, he has the freedom to use any kind of filter design technique for the lower 
dimensional state-space. The trade-off, however, is that the system reduction in Massoumnia’s filter is sensitive to 
the inexactness of the plant model. Variations in the plant will change the reachable subspace and may, as a result, 
degrade the performance of the reduced-order detector. In the game filter, the order reduction comes at the end of 
the design process. Thus, there is no design freedom left to tune the reduced-order filter, but the game formulation 
used to obtain the filter makes it possible to account for model uncertainties. Thus, it can be argued that the order 
reduction used here is more robust. ^ 

The Goh transformation and corresponding Riccat.i equation greatly extend our ability to analyze the reduced- 
order estimator. In fact, with the Goh Riccati equation we can show that there always exist a stabilizing solution for 
the reduced order estimator. Applying t.he transformation T to (74), we get. 


-rsT r = r.sT T r/ir T + r.4 r r T rsr r + tc t {hJq x Hi -V~')cr T 
+[rsr T ([\4r T rfl, - r b.) - rc T v~ 1 cr T r b.]( c t v~ 1 c s.r ' 

x[(r.4r 7 'r£, - rB,) T rsr T - rc T V~ l cr T rBi) (92) 
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Define: 


r Bi = 


B n 

By, 


As in section 5, the necessary condition SBj = 0 will lead to Bn — 0 since rSr T rf?» _ 0 => SB\ l — 0 and 5 is 
positive-definite. Also, if we carry the transformation through, a number of terms fall out because the projector H\ 
has been constructed so that: 


H\CBi — 0 => HiCr T YBi = 0 => [ J/jCi H X C 2 ] | = 0 => HiC 2 B l2 -Q (93) 

We we show later that Bi can always be augmented so that Bi 2 is an invertible square matrix. Hence (93) implies: 


H jC 2 = 0. 

Using (94) and working through all of the transformations leads to: 


-S 0 ] _ f SAu 5.4! 

0 0 j [0 0 



A n S 0 1 . ( ’ 

+ 

Aj,S 0 J + 1 


B n j _ 


civ 'c 2 b 12 
cTV~ 1 c 2 b i 2 


0 J - [ 0 0 J [ Aj,S 0 \^\[ 0 J [ c 7 v c 2 b 12 J J 

x(Bf 2 CZV~ l C 2 B l2 r 1 ( [ Bj,A l2 S- B n S 0 ] - [ B&CjV^Cl Bf 2 C?\r l CT ] ) 

f /-'T i isT r\ ti T7~ X \n. ^nTT/~ X 1 


CUHfQxHi -V-'fr -CjV l C 2 

-c%v~ l c y -c?v- l c 2 J 


(94) 


(95) 


From (95) we get three equations: 


-t = CUBfQiH, - V~ l )Ci +3 A u + Al?+(SA l2 B vi - SB n -CjV 1 C,B 12 )(Bl 2 C7 V l C 2 B l2 )~ l 



x(SAi 2 Bi 2 — SBn—ClV C 2 Bi 2 ) T 

(90) 

0 = -Cl V l C 2 + SAy. - (SA l2 B l2 -SBn-CjV 

l CT, B l2 )(Bl 2 ClV~ 1 C 2 B l2 )- 1 Bl 2 C7V ~ ' C 2 

(97) 

o = -clv~ l c 2 + clV 

~ 1 c 2 b v ,( b1 2 c7V~ 1 c 2 b 12 )~ 1 b1 2 c7V~ 1 c 2 . 

(98) 


However, if we post-multiply (98) hy By 2 and cancel terms we obtain the identity 0 = 0. If we post-multi ply (97) by 
B \2 we obtain: 


0 = SBn => B u =0. 


i99) 


Thus, we need only (9(5), which thanks to (99) can be simplified to: 



(100) 


-t = Cj(kjQx H l -V~ l \c l + SAn + Aj,S + (SA 12 B,, - Cf V 'c 2 B,,) 

xiByiCjV 1 C 2 Bi 2 )~ 1 (S Ai 2 Bi 2 — CfV C 2 Bi 2 ) t . 

Now if i=l, then J9, = F\ and the rank of Fj equals the dimension of the kernal of S. B 12 = F\ 2 will then be square 
and, moreover, it will be invertible since F\ was assumed monic. Given this, we can simplify (100) to: 

- V~ l )Ci + SA U + AnS + (SA 12 - CjV~ 1 C 2 ){CjV~ l C 2 )~ 1 (SAi 2 -CfV C 2 ) T (101) 

S(t 0 ) = 0 (102) 

where the boundary condition comes from (68). This leads us to the key result of this section. 

Theorem 6.1. The solution S to (101) gives a stabilizing solution for the reduced-order estimator (86). 

Proof. Using the same transformation to derive both (101) and (86) will ensure that S is of proper dimension for 
(86). Substitute S into (86) directly for TT. The resulting estimator is: 

hi = (An - [Shelv'd - C 2 I<) + A l 2 l<]C 1 )m + '(' - C 2 I<) + A 12 /v)y. (103) 

where K := (C^V~ X C 2 )~ l C^V~ l . Clearly, the stability of the estimator depends upon the closed-loop state matrix, 
(An - [5 -1 Ci’V _1 (/ - C 2 I<) + Ai 2 A')Ci). Now, if we go back to (101), multiply out the quadratic, and use the 
definition for K , we get: 

= S(An — Ai 2 A'Ci)+(A,, - Av>I\C\) T li +Cj [Hj Q\H i—V~' (I — C>K)]C\ + SA l 2 (CjV~ l C 2 )~ l Aj :i S. (104) 
If we add and subtract CjV~\l - C 2 /\ )C’i to (104) and rearrange terms we get.: 


-S = S(A n - Ay,KCi - S~'cfV *(/ - CjK )Ci) + (An - AnKCy - S 1 CjV (/ - C 2 A')Ci) t S 

+C'[[HjQ l H l + V~ l (I-C 7 K)\Ci + SA l 2(Cj\r 1 C2)- l A? 2 S)C 1 . (105) 

Note that CjV ' ( / — Cj A ) C 1 is symmetric. (105) implies: 


S + 5(An - ApjA'Ci - S~ l C’i r ‘(/ - CjIQCi) + (A n 


Ai .KCx-S l d[V '(/ - C 2 A')C,) t 5 < 0, (106) 


which by Lyapunov’s Direct. Method (21) implies that (An - A i2 kCi - S CjV (I - C 2 k)C\) is stable. For 
time-invariant systems, this implies that the closed-loop eigenvalues lie in the open left-half plane. II 
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What, happens, however, when i > 1 and diin(ker.S') > rank £,? Tlie matrix B i2 will no longer be square and the 
reduced-order Riccati Equation will be stuck in the form of Equation 100 which is not the same as what is needed 
in the proof for stability (Equation 101) It would thus seem that we cannot guarantee stability in the general case. 

It turns out, however, that by augmenting the failure map in the original problem statement, we can always 
convert the reduced-order Riccati equation into the desired form (101). The necessary augmentation turns out to 

be: 

F, = [Bi B,_ i ... B\ ) (107) 

The new game problem for the limiting case is: 


ninmaxJ' = f (Ik - * c + ( T “ *) T C T + W> 1 2\\j^ c thJq 1 h 1 cf , 

* Jt a * 

-||y - C* ||i-, - (y - CxfV-'CFuh ~ tfF T xC T V-\ y - Cx) - 


subject to: 

jr = Ax + F i/I 2 0^9) 

where jr 2 is the augmented failure signal which has many inputs as there are columns in F 1 . Note, that here we have 
gone back to the p re- transformed problem (where the state is x, not or,). We will show that this new problem leads 
to a Riccati equation which is equivalent to (74) In this equation, however, the reduced-order version is easily seen 
to reduce to the desired form (101). The equivalence of the two equations then implies that the same reduced form 
holds for both. 

The augmented failure map, F l is such that CF { # 0, thereby stopping the transformation process after one 
iteration. The solution to this game leads t.o a Goli Riccati Equation: 


-S = SA + A t S + C T (HjQi Hi - V' l )c + [S{AFi - Fi) - C T V , CFi] 

x(7Tc t F- , C7 , i)- , [(^i -t,) T 5- T T x C t V- X C) (110) 


with a boundary condition given by (08). The solution, S, to (110) is such that. dim(kerS) — rankFj. Hence, after 
the transformation and defining: 
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the reduced-order Riccati Equation: 


-i = Cj{HjQ\H\-V ')C l +SAn+Aj 1 S + (SA n Fv2-ClV l C 2 F 12 ) 

x(f t 12 cJv~ 1 c 2 f 12 )~ 1 ( 5 ^ 12^12 - C[\r l c 2 F l2 ) T ( 111 ) 

can be simplified to (101) because F n is square and invertible. We know that F 12 is square and invertible because 
the construction of Fj ensures that Fi has full column rank and that the size of ker S, which determines the order 

reduction, is equal to this column rank. 

Proposition 6.2. The Goh Riccati Equation of the augmented system (HO) is equivalent to the Goh Riccati 
Equation of the original system (74). 

Proof. It is immediate that 

CF, = C [ Bi ... B l ]=CB i (H2) 

If we examine the term SAF » — F\ in (110): 

SiAFr-h) = SA[ Bi B,_i ... Bi]+S[B,- B.-i • Bi ] 

= [ SABi - SBi , SABi-i -SBi SABi - 5Bi ] 

= [ SAB; - SBi, SBi, SB^ i. -,SB 2 ] - 

Because of Proposition 4.2, this simplifies to 

S(i4Fi — T\) = S(ABi — Bi). (113) 

Given, (112) and (113), the Goh Riccati Equation for the augmented system (110) simplifies to (74). II 

Reduced-order filters for the time-varying are much harder to come by since the transformation matrix, T, will 
now be a function of time. In this case, the only likely option left, to the analyst is to use the results of [22] which give 
differential equations for the eigenvectors and eigenvalues of the solution to a time-varying Riccati Equation. From 
here the reduced-order Riccati Matrix, the transformed system equation, and finally the reduced order filter can be 
formed through a transformation matrix based upon the eigenvectors. Needless to say, the computation required 
here will be quite intensive. The state and measurement matrices will also have to be transformed at each time step 
and only then can the filter be formed and propagated. The point here is that it is possible to find a reduced filter 
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for the time- varying case, though the effort may outweigh the benefits. Since the full-order filter is always available, 
this is not a serious problem. 

The analyst, has many options when designing a game theoretic filter. In the case of the full-order filter he 
has the freedom to choose the different weighting matrices and 7 . For reduced-order filters, lie can use either the 
solution to the Goh Riccati Equation (74) or the solution of linear matrix inequality (56) with 7 = 0 to find the 
needed transformation matrix and reduced-order filter gain. He also has the reduced-order Riccati Equation (101). 
Moreover, he can mix the two approaches (e.g. using the LM1 to find the transformation matrix and using the 
reduced-order Goh Riccati Equation to find the gain). This flexibility is important, because the solution to the 
Goh equations may be ill-conditioned when several iterations of the Goh Transformation are needed to generate the 
Riccati Equation. The appearance of powers of A in the resulting equation may cause problems with the numerical 
solution. Thus, though the Riccati solution represents the saddle-point solution, it may not be the best choice from 
numerical considerations. 

7. Example: Accelerometer Fault Detection for the F16XL 

7.1 Problem Statement 

To demonstrate the effectiveness of the game theoretic filter, the F16XL example of [5] is re-examined. The aircraft 
dynamics are linearized about trimmed level flight at 10,000 ft altitude and Mach 0.9. For simplicity, a reduced-order, 
five-state model of the longitudinal dynamics (including a first-order wind gust model) is considered: 


jt — j4t "f 


y = Cx -f v. 


The five components of the states are: 


j — 


The measurements are: 


u 

tn 

n 

e 

«’y 


^ long, velocity (ft/sec) 
normal velocity (ft/sec) 
> pitch rate (deg/sec) 
pitch (deg) 
wind gust (ft/sec). 


(114) 


v = 


n 

6 

A , 

A r 


pitch rate (deg/sec) 
pitch (deg) 

long, acceleration (ft./sec") 
normal acceleration (ft./sec~). 


(115) 


The input, v > wg , is windgust and »> is the sensor noise, v is also assumed to be weighted by V = i>U. The resulting 


system matrices are: 

* 2 <) 



-.0674 

.0430 

-.8886 

-.5587 

.0430 

.0205 

-1.4666 

16.5800 

-.0290 

-1.4666 

.1377 

-1.6788 

-.6819 

0 

-1.6788 

0 

0 

1 

0 

0 

0 

0 

0 

0 

-1.1948 

B t 

© 

o 

II 

0 0 

2.0156 ] , 



0 0 1 0 0 

0 0 0 1 0 (118) 

C - 0.0139 1.0517 0.1485 -0.0299 0 

-0.0677 0.0431 0.0171 0 0 

It is desired to detect a normal accelerometer fault, A z , in the presence of the wind gust disturbance and the 
sensor noise. Following the modelling techniques described in section 2, we incorporate the accelerometer faults into 
the system by modifying our state equations to: 


it = Ax + Bw wt 

xj = Cx + Ea.Ha, + v - 

where E A = [ 0 0 1 0 ] T and fi A , is the acceleromter failure signal. We then convert (119) and (120) into: 

X = At. + F A ji At + Fw/Hwj 

y = Cr + v, 

F wg is simply B wf ; t i wa is the wind gust, w wg . The failure map, F A , and the failure signal are: 

' 0.6003 0 

0.9429 -1.3706 , s 

Fa .= o -1.5003 /M. = {;,;} 


Finally, the natural projections on the filter residual are: 


0.5330 0 -0.4982 -0.0264 ] 

0 10 0 


Hi = I — (Cv4F 1 „ < )[(Cj4F,„ # ) T (Ci4F„, J )] (CAF wf ,) — _o .4982 0 0.4685 —0.0281 

-0.0264 0 -0.0281 0.9985 


N x = / - Hx = (CAF wa ){{CAF w ,) T (CAF„, 9 )}-\CAF W!l ) T = 


0.4670 0 0.4982 0.0264 
0 0 0 0 
0.4982 0 0.5315 0.0281 
0.0264 0 0.0281 0.0015 
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7.2 Full-Order Filter Design 


Equation 34, the Riccati Equation in terms of P, was used for this example, though we could have just as easily used 
(31), the Riccati Equation in terms of II. To bring sensor noise weighting, V (= i/7), to zero with the disturbance 
bound, it is assumed that v is some multiple of j. By trial and error, it was found that: 



1 / = 5 x 10 -8 , — = 2 

7 

Qi = 

II 

£ 

II 

/ 

gave the results seen in Figure 1. For the given parameters above, 

the solution 

of (34) is: 


.019161 -.25947 

-.20981 

-.00448 

11.059 


-.25947 7.5971 

7.1863 

.076754 

-376.33 

X 

1 

o 

II 

-.20981 7.1863 

7.9932 

.011879 

-428.83 


-.00448 .076754 

.011879 

.00397 

-.098976 


11.069 -376.33 

-428.83 

-.098976 

45255 


resulting in a gain: 



' -2.0981 

-0.0448 

—3.0364 

-0.16068 


71.863 

0.7675 

90.611 

4.679 

L = 

79.932 

0.1188 

87.416 

4.6062 


0.1188 

0.0398 

0.8230 

0.0381 


-4288.3 

-0.9897 

-4593.1 

-243.02 



Figure 1: Frequency Response of Accerometer Fault vs. Frequency Response of Wind Gust (solid line - output due 
to fiA t \ dashed line - output, due to gt wg ) 

Figure 1 is a plot of the Euclidean Norms of the signal z\ := H \C(y — Ct) due to the fiA t <md fhvg- The pertinent 
transfer functions are: 
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= HiC(mI -A + LC)- l LE, 

/M.(s) 


= H x C{sI -A + LC)- l F, 

liu, S [s) 

It can been seen that at least 130 dB of separation exists between the output due to the wind gust and the output 
due to the accelerometer fault. This should be satisfactory. 



Figure 2: Inner Product of the Closed-Loop Eigenvectors and Fault Direction 1 


The asymptotic convergence of the game theoretic filter to a fault detection filter structure can be demonstrated 
with the analysis of [4]. In that filter, the closed-loop eigenvectors are placed in such a way that, for each fault, j its 
complementary detection space, T, = is decimated. The complementary detection space is spanned by the 

faults which are not meant, to be seen. This condition can be represented by the linear equation: 

' a t - a,/ c T i r v; i _ r o i 
f t 0 J [ Wi J " [ 0 J 

From (126) we conclude that. 

(A T - X,I)V, +C T W, = 0 

FfK = 0 


(126) 

(127) 

(128) 
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leading to the following conditions: 

(A t +C t L t - A,/)K = o (129) 

FfVi = 0. (130) 

We can conclude from (129) and (130), therefore, that in a fault, detection filter the complementary fault directions 
are perpendicular to the closed-loop eigenvectors. 

In Figures 2 and 3 we employ Equation 130 and examine the eigenst.ructure of the game theoretic filter as the 
parameters v and 7 are taken to zero (7 = /'/2). Figure 2 shows a plot of F* ug Vi (* = 1. 5) where V, are the 

eigenvectors of (A + PC T V~ , C). Figure 2 shows that the closed-loop eigenvectors (two in particular) become 
perpendicular to the directions of F wg . Since we have designed the filter to block out the transmission of /i„ s to a 
portion of the state-space, this is the result we would expect. 

Figure 3 shows that the closed-loop eigenvectors do not align in directions normal to the space spanned by F At . 
Decreasing values of 7 seem to have no efiect. on alignment, in fact. Since this is the fault that, we want to detect., 
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this is the result that we want to see. 


7.3 Reduced-Older Filter Design via the Goli Riccati Equations 

We now repeat the example, but now we will design a lower order detection filter using the Goh Riccati Equations. 
The first step is to derive the transformation matrix, F Since the transformation is determined via the null space of 
the full-order Riccati Matrix, the design process begins by finding the solution to the full-order Goh Riccati Equation 
(74). Because CF\ = CB l = 0, we need to go to a second iteration (» = 2), in which we find that: 

B 2 = AB\ = AFi ( 131 ) 


Using (131) and the same weightings as in the full-order design, we find that the solution to the Gon Riccati 
Equation (74) is: 


-4.6032 

7.0275 

-6.0662 

-123.5565 

-0.2697 

-5.2351 

2.5842 

-2.2990 

-48.2081 

-0.1353 

4.4622 

-2.0830 

1.8578 

39.0486 

0.1115 

85.2718 

-36.2789 

32.4847 

698.8667 

2.0423 

-0.0098 

0.0079 

-0.0069 

-0.1432 

-0.0003 


Using the QR decompostion we find obtain a transformation matrix: 


-0.0537 

-0.9954 

-0.0763 

-0.0175 

0.0091 

-0.0611 

-0.0667 

0.7407 

0.5738 

-0.3374 

0.0521 

0.0332 

-0.6631 

0.6384 

-0.3860 

0.9953 

-0.0596 

0.0761 

0.0009 

0.0001 

-0.0001 

-0.0007 

-0.0062 

0.5128 

0.8585 


Using this transformation, we reduce our state-space to a third-order system (i.e. we find the matrices -Au.Ci etc.). 
From here we employ the reduced-order system matrices in the reduced order Goh Riccati Equation, (110). The 


soltution to (110) using (133) is: 

219.8389 -14.6664 -0.2469 1 

5 = -14.6664 5.2528 0.1179 ( 134 ) 

-0.2469 0.1179 0.0035 

with a corresponding gain: 

' -0.0066 0.0061 0.0005 0.0033 1 

L= -0.3211 0.1887 0.0068 0.1483 (135) 

8.4710 -7.2336 4.3S27 -5.6715 

The closed-loop eigenvalues are -0.0375 ± 0.0 128 j, -5.1698. Compare this to the eigenvalues of the full-order filter 
which are: — 0.0344±0.0448j, — 88.40±88.57j, —14.9142. To demonstrate the effectiveness of the reduced-order filter 
a linear simulation of the system was run for two cases: one with a accelerometer fault input (modelled as a step) 
the other with a windgust. input (also a step). Figures 5 and 4, shows that the reduced-order filter responds to the 

accelerometer fault input and is relatively insensitive to the wind gust, input. 
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Figure 4: Reduced-Order Goh Filter Residual due to step in / i A . (fault to be detected) 


7.4 Reduced- Order Filter Design via tlie Linear Matrix Inequality 


We will now demonstrate yet another design algorithm. Compared to the previous design, this approach requires 
more work and judgement from the engineer, but the final filter design is very effective and in some cases the approach 
may be numerically more reliable. 

The linear matrix inequality (56) was solved in the steady-state case using software for semi-definite programming 


software 3 . For 7 = 0 and the same weighting matrices as the full-order design, it was found that; 



3.4282 

- 0.1842 

0.2482 

6.4511 

- 0.0000 


- 0.1842 

1.0263 

- 0.9014 

- 17.1934 

- 0.0000 

n = 

0.2482 

- 0.9014 

0.7978 

15.1839 

0.0000 


6.4511 

- 17.1934 

15.1839 

301.6193 

- 0.0000 


- 0.0000 

- 0.0000 

0.0000 

- 0.0000 

0.0000 


Using the eigenvectors of the Riccati matrix (136), we obtain the following as a transformation matrix: 


( 136 ) 


T — 


0.0211 

— 0.6823 

- 0.7307 

- 0.0026 

- 0.0088 


0.0002 

- 0.0058 

- 0.0066 

0.0000 

1.0000 


0.0575 

- 0.7266 

0.6804 

- 0.0769 

0.0003 


0.9979 

0.0575 

- 0.0249 

- 0.0170 

- 0.0000 


- 0.0215 

0.0568 

- 0.0502 

- 0.9969 

0.0000 


Following the results of the previous section, we choose the reduced-order estimator to be 3rd order, with the 

corresponding reduced Riccati Matrix: 

3 “SP" developed at Stanford University hy Stephen Boyd and his students 


35 





Figure 5: Reduced-Order Goh Filter Residual due to step in /i», (nuisance fault) 

‘ 3.3129 -0.0000 0.0000 

IT= -0.0000 305.3302 -0.0000 
0.0000 -0.0000 0.0633 

The resulting gain is: 

' 0.0162 -0.0035 -0.0153 -0.0005 "I 

L = -0.6843 0.0740 0.6642 0.0130 (137) 

178.7185 -19.9610 -169.0275 -5.8971 

The closed-loop poles are -0.0347 ±0.0448j, -243.4 (Note that, the dominant second-order pair of the full-order filter 
has been retained). 

Again by simulating the reduced-order system, we find in Figures 7 and 6 that the reduced-order filter works 
effectively as a fault detector for an accelerometer fault, in the presence of a windgust fault. Figure 6 shows that the 
reduced-order estimator is sensitive to ,, Al> the accelerometer fault, whereas Figure 7 shows quite clearly that the 
reduced-order filter is unaffected by the presence of a windgust fault (the residuals are on the order of 10 6 ). 

8. Conclusions 

By solving the fault detection problem via disturbance attenuation, we obtain a game theoretic filter that bounds 
the transmission of disturbances and nuisance faults. By going to the limit of this solution, we get a fault detection 
filter which in the time-invariant case is equivalent, to the Beard-Jones Fault Detection Filter. That is, the presence 
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Figure 6: Reduced-Order Filter Residual due to step in /i*, (fault to be detected) 

of the nuisance faults is restricted to an invariant subspace that can be made unobservable through a projection. 
This unobservable subspace can be factored out of total space to get a lower-order system which is uninfluenced by 
the nuisance faults. The same factoring process can then be applied to the game filter to get a reduced-order fault 
detector for the newly reduced state-space. Extensions of this latter result exist for the time- varying case, though 
the computation involved may be intensive. 

The game theoretic approach to fault detection filter design is more flexible and applicable than current design 
methods. The designer can choose the degree to which the game filter possesses the structure of the Beard-Jones 
filter. This allows him to make tradeoffs between nuisance fault blocking and sensor noise rejection. The linear 
quadratic game used to solve the disturbance attenuation problem admits time-varying systems and can be used to 
incorporate parameter uncertainty into the filter design. Recent extensions of robust control such as designs which 
constrain pole-placement, and designs with multiple objectives (e.g. the so-called mixed H 2 / #oo problems) suggest 
that the same can be done here. The latter is of particular interest since it appears to be a logical way to detect and 
identify multiple faults with a single game theoretic filter. 

Finally, we have shown that the limiting form of the game filter is a singular filter. Since any disturbance 
attenuation problem can be solved in the same manner as this one, it is likely that this result applies to all such 
problems. That is, the limiting form of a disturbance attenuation problem is a singular optimization problem. This 
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Figure 7: Reduced-Order Filter Residual due to step in ft wf (nuisance fault) 

makes applicable a wealth of results from singular control and it provides a new way to understand H x problems 
by looking at them as “almost” singular optimal cootrol problems. 
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